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Abstract 

Dynamical control of excitable biological systems is often complicated by the difficult 
and unreliable task of pre-control identification of unstable periodic orbits (UPOs). Here we 
show that, for both chaotic and nonchaotic systems, UPOs can be located, and their dynamics 
characterized, during control. Tracking of system nonstationarities emerges naturally from this 
approach. Such a method is potentially valuable for the control of excitable biological systems, 
for which pre-control UPO identification is often impractical and nonstationarities (natural or 
stimulation-induced) are common. 
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Chaos control techniques have been applied to a number of excitable biological systems [jT], 
B S @' 01 comprised of spontaneously firing cells. Such control typically attempts to replace an 
unwanted irregular or higher-order firing pattern with a lower-order periodic rhythm. One partic- 
ular control technique, PPF control [[[]], uses isolated electrical stimuli to cause the cells to fire at 
a specified time, thus altering the variable of interest, the inter-excitation interval. In the idealized 
situation presented in Refs. [[]]] and [Q] the PPF stimuli achieve control by placing the state of the 
biological system onto the stable manifold of a desired unstable periodic orbit (UPO). 

The successful application of PPF control requires an estimate of the location of the uncon- 
trolled system's UPO and corresponding manifolds. UPOs and their eigenvalues [||] are typically 
characterized from measurements of the system in free-running mode, without external stimula- 
tion [[I], 0| . PPF-type [0] stimuli are then used to alter the inter-excitation interval in an attempt to 
place the system state point onto the estimated stable manifold and therefore stabilize the UPO. 

Proper estimation of the UPO and its characteristics is of fundamental importance to PPF-type 
control for several reasons. First, optimal control (which we consider to be stabilization of the 
desired UPO with a minimal number of stimuli) is achieved when the system state is placed onto 
the stable manifold. Without placement directly onto a stable manifold, control can be achieved 
via alternative dynamical mechanisms [§, |9|, [K| [TTj, [12|] that require more frequent stimulation. 
Second, knowledge of unstable orbits can provide a skeleton upon which to build a model of the 
overall system. Third, the UPO may change in time; by continuously tracking the properties of 
the orbit, one can adaptively change the control parameters in order to maintain the controlled 
stability of the orbit. Changes in the UPO may stem from autonomous drifts in the properties 
of the biological system, or may be a response to the control stimuli (a tissue's dynamical or 
electrochemical properties may be modified by stimulation [O, M). With these reasons in mind, 
this report is concerned with ways to use PPF-type control in order to identify, control, and track 
such UPOs and their manifolds. 

The detection of a UPO using data collected in the uncontrolled, free-running system [JIJ, [2p 
can be problematic. As mentioned above, one problem with such an approach is that excitable 
biological systems are commonly nonstationary. Thus, a pre-control UPO estimate may become 
invalid before or during the control stage. Another problem is that in the free-running system, 
the system's state may spend little time in the vicinity of the orbit. As an extreme case, a system 
with a stable attracting periodic orbit may well have other UPOs, but the free-running system 
will visit only the stable orbit. Even with a lengthy free-running data collection stage, there is 
no guarantee that there will be sufficient data from within the UPO neighborhood; a paucity of 
such data from within the UPO neighborhood renders dubious the reliability of the estimated UPO 
characteristics. Statistical tests have been proposed to validate UPO existence [|T3|], but the most 
compelling evidence comes when control of a putative orbit is successfully achieved. With this in 
mind, an alternative to pre-control UPO identification is to locate and characterize a UPO while 
attempting control. 

To this end, Kaplan [ |T2] ] recently showed that control can be used to locate UPOs by tuning 
the control parameters to be near a bifurcation in the controlled system's dynamics. Such control 
allows the experimentalist to circumvent the major hurdle of pre-control UPO identification: the 
limited time that the state point spends in the UPO neighborhood. However, although the system's 
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state stays near the UPO during such control, estimation of UPO characteristics is complicated by 
the fact that the natural UPO dynamics are masked by the control stimuli. So, the experimentalist 
faces a choice of studying the free-running system with infrequent UPO data, or studying the 
controlled system with plentiful data but with obscured or altered dynamics. As we show in this 
report, the latter alternative can be rendered feasible by circumventing the masking in either of 
two ways: 1) estimating the natural UPO dynamics between intermittently applied stimuli or 2) 
jiggling the control parameters. 

We will examine systems whose natural, uncontrolled dynamics can be approximated by an 
autoregressive system x n+1 = /(x„, x n _i). Such systems can have many types of UPOs. For 
control of excitable biological systems, x n is taken to be the time interval between the n th firing of 
the system and the previous firing. As long as the state point (x n , x n -i) is in the neighborhood of a 
UPO, the system dynamics can be approximated linearly as x n+ \ = ax n + bx n -\ + c, or, rewriting 
the constants a, b, and c in terms of the parameters of the UPO: 

x n+ i = [X s + X u )x n — X s X u x n _i + x*(l + X S X U — X s — X u ) (1) 

where X s and X u are the eigenvalues of the linearized system, and x+ is the location of the UPO 
sampled once per cycle. The notation is intended to suggest that there is one stable and one 
unstable eigenvalue, as required for a saddle-type fixed point. However, the equation is applicable 
even when both eigenvalues are unstable. 

The application of PPF-type control changes the dynamics near the UPO to a nonlinear form: 

x _ m ^ n i i^s + X u )x n - X s X u x n ^ 1 + x^(l + X S X U - X s - X u ) natural dynamics 
n+ \ X s (x n — x+) + x* control stimulus 

where x* and A s are estimates of the UPO position x+ and stable manifold slope A s . Kaplan [ |T2"[ ] 
showed that for a flip-saddle, when x+ ~ and |A S | < 1 the controlled system modeled by 
Eq. [Z] will be characterized by a control stimulus applied either every interval (when x* < x*) or 
every second interval with the intervening intervals being terminated naturally (when x* > x*). 



As shown in Ref. [|T2J, x* can be located by systematically scanning over a range of x* for the 
stimulus-pattern bifurcation. 

In the system of Eq. ^, because the natural dynamics are obscured by the control stimuli, it is 
not possible to estimate A s and X u . For the case where x± < x*, (when control stimuli are applied 
every interval), the controlled dynamics are simply 

%n+l — X s (x n X*) -|- X*. (3) 

The natural A s and A n do not enter into these dynamics and therefore cannot be estimated from 
them. For the case where x* > x* (when control stimuli are applied every second interval), the 
controlled dynamics for intervals that end naturally without a control stimulus, are 

x n+ i = (X S (X S + X u ) - A s A u )x n _i + (1 + A S A„ - A S (A S + A„))f; (4) 

(as can be found by substituting the bottom equation of Eq. ^ for x n in the top equation). Note that 
from measurements of x n+ i and x n _i, only the lumped constant parameter A S A U — X S (X S + X u ) in 
Eq. |] can be estimated, and not X s and X u individually. 
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Christini and Collins [ |TT| ] proposed a simplified modification of PPF control, which they termed 
SMP control. They showed that effective control can be accomplished by turning off the control 
stimuli and allowing the system to free-run according to the natural dynamics until the state point 
(x n , x n -i) wanders out of the UPO neighborhood. Only when the difference between (x n , x n -\) 
and the UPO (x*,x*) reaches a threshold is control reactivated to return the state point to the 
UPO neighborhood via the stable manifold. In Ref. QTT]], the primary motivation for such inter- 
mittent perturbation was to minimize control interventions in order to limit stimulation-induced 
modification of the dynamical or electrochemical properties of the excitable tissue [ |T3| , [I3p. In the 
present context, intermittent stimulation provides another important benefit: allowing observation 
and characterization of the natural UPO dynamics between control perturbations. 

When the control stimuli are turned off when using the SMP strategy, the system dynamics near 
the fixed point are given by Eq. [[]. The parameters A s , A„, and x* can then be estimated by linear 
regression of x n+ i on x n and x n _i. We define a "natural triplet" to be a sequence (x n+ i, x n , x n -i) 
in which interval n + 1 is terminated naturally, but intervals n and n — 1 could be terminated 
naturally or by control stimuli. Only natural triplets can be used in the regression. 

In order to track UPO drift, estimates of X s , X u , and x* are made from the last N natural triplets 
(x^+i, x n , x„_i). In this letter, we take N = 10. After each estimation, the control parameters X s 
and x± in Eq. ^ are adjusted accordingly. 

Care must be taken when performing the linear regression. If only one eigenvector is required 
to characterize the data fit to Eq. 0], then the parameter estimations will not accurately represent 
the natural two-manifold UPO dynamics. This situation occurs when one of the manifolds has 
little or no influence on the state dynamics for several consecutive natural triplets. For example, 
when control is turned off when using the SMP strategy, the state point will tend to retreat from the 
UPO along the unstable manifold. Thus, the natural dynamics will be x n+ \ = X u (x n — x*) + x*, 
which does not reflect \ s . If the N points used in the estimation consist mainly of such points, the 
parameter estimations will not accurately represent the natural two-manifold UPO dynamics. Such 
a situation can be detected by using singular value decomposition (SVD) [ JRI to carry out the linear 
regression: if the ratio between the regression's largest and smallest singular values is exceedingly 
large, the estimate is dubious. If this is the case, x* and A s from the last valid estimation of Eq. |T] 
should be used for setting the control parameters in Eq. 0. 

We illustrate the SMP characterization and tracking technique using the chaotic Henon map, 

x n+ i = 1.0 - Ax\ + Bx n -i, (5) 

where A = 1.4, B = 0.3, and x n represents the n th inter-excitation interval. With these parameter 
values, the system is chaotic and has a flip-saddle UPO at x* = 0.8839, with X u = —1.9237 and 
X s = 0.1559. Figure [I] shows a trial demonstrating the adaptive estimation and control of this 
UPO. Initially, the Henon map was free-run for 100 points without control [Fig. [11(a)]. At n — 100, 
control was activated, setting the control parameter A s = and scanning for x* by systematically 
increasing x*. For x* < x± the resulting controlled dynamics show a fixed point at x+ with the 
control stimulus being applied at every interval. At = x+, a period-doubling bifurcation occurs, 
thus marking the location of the flip-saddle UPO. As shown in the inset of Fig. |l](b), the bifurcation 
occurred atn= 174. 
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Following detection of the bifurcation, control continued with x* set to 0.9073, the midpoint 
of the last pre-bifurcation pacing interval and the first post-bifurcation pacing interval. After N 
natural triplets had occurred [see inset in Fig. [IJb)], the first SVD estimation of A s , A u , and x* was 
performed [[FT]]. After n — 190, control followed the SMP protocol, with control stimuli used only 
when \x+ — x n \ > 5. (5 was set to 0.001 for all trials in this study.) SMP successfully stabilized the 
UPO with control stimuli being provided approximately every 20 th interval as seen in Fig. |T](c). 
Figure [j](d) shows that the control-stage SVD estimates A s and X u (re-estimated via SVD following 
every natural interval using the most recent iV natural triplets) were close to their true values. 

After n = 500, to simulate a noisy system, a Gaussian white noise iterate (standard deviation 
0.0001) was added to each non-controlled Henon map iterate. In the noisy system, control required 
more frequent SMP perturbations because the additive noise caused the system state point to wan- 
der more quickly away from a;*. Due to the additive noise, A s and X u fluctuated, but remained 
scattered around the true values [Fig. [j](d)]. 

This technique can also be used to locate and stabilize UPOs in nonchaotic systems. We per- 
formed a trial controlling the Henon map of Eq. |] with A = 1.0 and B = 0.3. With these parameter 
values, the system settles into a stable period-4 rhythm. However, there is an underlying unstable 
flip-saddle UPO at x* = 0.7095, with X u = -1.6058 and A s = 0.1868. This UPO cannot be 
detected from free-running data, but the bifurcation search, SVD parameter estimation, and SMP 
control were able to locate and stabilize the UPO. For this trial, the bifurcation search, control per- 
turbations, and manifold estimations were all qualitatively similar to those shown for the chaotic 
Henon map in Fig. |T| As in Fig. [I], control remained effective when a Gaussian white noise iter- 
ate (standard deviation 0.0001) was added to each non-controlled Henon map iterate. Given the 
prevalence of pathologic nonchaotic rhythms in excitable biological systems [0, |J |5p, this example 
demonstrates an important capability of this control technique. 

It is of particular interest to be able to track drifting UPOs in nonstationary systems. To illus- 
trate how this can be done, we use the Henon map with a randomly drifting parameter: 

x n = 1.0 - (A + r] n )x 2 n _ x + Bx n -2, (6) 

where r\ n is an iterate of a correlated noise process [[181], given by rj n = 0.999r7 n __i + 4.5 x 10~ 7 C 



in 



where ( n is Gaussian white noise with unity standard deviation. Figure [|(a) shows the inter- 
excitation intervals for a control trial of this nonstationary system. Figure 0(b), (c), and (d) show 
the analytically-determined x+ n , X Sn , and X Un , respectively, and their SVD estimates x+ n , X Sn , 
and X Un , respectively. These panels demonstrate that the repeated SVD estimation was able to 



effectively track the drifting parameters Q19fl. 



A second method for estimating A s and X u is applicable when the natural unstable dynamics 
are sufficiently strong that SMP control cannot be practically applied. As shown in [|12|], it is not 
necessary for the control parameters X s and x* to match the natural parameters X x and x* in order 
to accomplish successful control. In the case of a flip saddle, for example, by setting the control 
parameter x+ slightly larger than the true fixed point location x+, the controlled system will have 
a period-2 orbit, where control stimuli are provided every second interval. By jiggling the control 
parameters in a small range around their nominal values, one eliminates the linear degeneracy of 
Eq. |3] and enables A s and X u to be separately estimated from the natural triplets (x n+ i, x n , x n _i). 
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The techniques presented in this study dispense with pre-control data analysis and enable con- 
trol of nonstationary UPOs in chaotic and nonchaotic systems. Thus, they are more appropriate 
than previous techniques for control of excitable biological systems. This fact, coupled with exper- 
imental evidence that model-independent control techniques can modify or eliminate pathological 
excitation patterns [jl], |5p, implies that they may have clinical utility. As one possibility, we note 
that in some clinical applications of tachycardia pacing, one uses rapid pacing in order to cap- 
ture the tissue's rhythm, and then gradually slows pacing to return the heart to an acceptably slow 
rhythm. The techniques described here may be useful in maintaining capture of the rhythm while 
the pacing rate is slowed. 

While this study demonstrates the feasibility of controlling models of excitable biological sys- 
tems, important questions regarding the physiological feasibility of control of real excitable bio- 
logical systems remain unanswered. One question is whether or not excitable biological systems 
actually contain UPOs. This is a topic of considerable research and debate [ [201 , P"5l [HI j22[ ]. An- 
other question is whether SMP control stimuli, which are large perturbations to the electrochemi- 
cal properties of the system, actually modify the underlying UPO dynamics [ |TT| , [T3| , |14| ]. Further 
investigation is needed to address these, and other, issues to determine whether such control is 
physiologically feasible and clinically useful. 
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Figure 1: A trial controlling the chaotic Henon map of Eq. |[ (a), (b), the inset in (b), and (c) show 
the intervals x n versus interval number n for various stages of the control trial. Natural intervals 
are shown as filled circles, while control-induced intervals are shown as open triangles, (d) shows 
the SVD estimates (re-estimated following every non-control interval) \ s and \ u during the control 
stage. 



Figure 2: A trial controlling the modified Henon map of Eq. ^|. (a) and the inset in (a) show the 
intervals x n versus interval number n for the entire trial. Natural intervals are shown as filled 
circles, while control-induced intervals are shown as open triangles, (b), (c), (d), and the inset in 
(d) show the analytically-determined (open circles) x+ n , X Sn , and \ Un , respectively, and their SVD 
estimates (closed circles behind the open circles) x± n , \ Sn , and X Un , respectively. 
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